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ABSTRACT 
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instrumental in the development and implementation ofc various ^ 
workshops directed toward the improvement of educational evaluation 
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and evaluation reoort writing. A theoretical local school system 
compensatory education program was used as a case study upoh ^which 
the various activities were focused. Approximately 130 local school 
systems and 40 State Department personnel were in attendanc^e during 
the two-day workshop. This monograph presents the information 
determined necessary within the report writing phase of the training. 
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PREFACE 



The Louisiana Round Table of Program Evaluators was organized in 1980 
among educational evaluators from large parish school systems and the State 
Department of Education to discuss topics of mutual concern. Since its 
inception the group has been instrumental in the development and 
implementation of various workshops directed toward the improvement of 
educational evaluation across the State. 

During November 4-5, 1982 , the Round Table presented a Statewide 
training workshop for local program evaluators and compensatory education 
coordinators in Baton Rouge, Louisiana. The two-day program focused on 
evaluation design, instrument development, and evaluation report writing. A 
theoretical local school system compensatory education program was used as a 
case study upon which the various activities were focused. Approximately 
130 local school systems and 40 State Department personnel were in 
attendance during the two-day workshop. This monograph presents the 
information within the report writing phas^ of the training. 
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COMPENSATORY/REMEDIAL EDUCATION PROGRAM 
Evaluation Workshop Training Teams 
(November 4-5 , 1982) 



Team 1 John Austin , Jefferson Parish 

Jerome Matherne, West Feliciana Parish 
Jodi Bonner, Bureau of Evaluation , 
Cormell Brooks, Orleans Parish 
Kathleen Orgeron, Jefferson Parish 



Team 2 B a rba ra B a n kens , Calcasieu Parish 

Ellen Gillespie, Bureau of Evaluation 

Sarah Morrison, Department of Administration 

Carol Scott, Jefferson Parish 



T^am 3 Lee Hoffirhan , Bureau of Evaluation 

Chuck Hunter, Bureau of Evaluation 
Antoinette Price, Caddo Parish 
James Taylor, St. Charles Parish 



Team U Janella Rachal , Bureau of Evaluation 
Ellen Pechman, Orleans Parish 
Delores Lewis, East Baton Rouge Parish 
Susan Stewart, Bureau of Evaluation 



/ 

FUTURE ACTIVITIES OF THE ROUND TABLE 
OF PROGRAM EVALUATORS 



As part of its continuing effort to strengthen educational program 
evaluation in Louisiana, the Round Table plans to sponsor additional 
workshops during the spring and summer of 1983. One two^day session is 
planned in the area of data collection, data management, and statistical 
analysis. A second workshop is being planned to coincide with the 
submission of local compensatory education evaluation reports by the State's 
66 systems. This workshop will focus on meta-evaluation and will examine 
the actual reports submitted to the State Department of Education In 
compliance with Act 433 of the State's compensatory education law. 
Additionally, the members of the Round Table will continue to serve as 
resource people to provide support and assistance to local evaluators who 
request their services. 

2 
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A GUIDE TO THE DEVELOPMENT OF EVALUATION REPORTS 



BACKGROUND 



Functions of an Evaluation Report 



An evaluation report is designed to provide written information 
concerning the worth/merit of the program or project being evaluated. It 
serves as an official record of the study and communicates to its audience 
the specific procedures employed in the collection of data used to answer the 
questions raised by the client. The conduct of the study should adhere to 
the Louisiana State Board-adopted Joint Committee Standards for the 
Evaluation of Educational Programs, Projects, and Materials. 



Reports for Specific Audiences 

Most evaluation reports are generally disseminated to several diverse 
audiences. The needs of these audiences may vary widely. In preparing 
multiple versions of an evaluation report, you may find the following 
guidelines of some assistance: 

1) Know your audiences 

2) Find out what information they need, why they need it, and when 
they need it 



U) Relate the information to action that must be taken 

5) Do not give the audience more than it needs 

6) Start with the most important information 

7) Highlight the important points 

8) Make the report readable and understandable 

9) In oral presentations: 

a. Make the presentation interesting and varied 

b. Do what comes naturally in your delivery 

c. Make visuals " large and simple o 

d. Involve the audience 

e. Reinforce the important points 

10) In working with the press, prepare background information 
concerning the program and prepare news releases to facilitate 
accurate reporting of the results. 

Evaluation reports can usually be categorized into four basic types. A 

description of each along with the intended audiences is provided below. 



1. Technical report--to audiences for whom the dissemination of the 



3) 




report is required. 



ERIC 



Examples: State Department of Education 
Program administrators 
Professional colleagues 
School Board 
Central office staff 



Executive summaries of the report- for decision makers and policy 
development groups. 

Examples: School Board members 
Central office personnel 

Data summaries-for program participants involved in supplying the 
data and implementing the program. 

Examples: School principals 
Teachers 

Special condensations of the report-for interested parties with 
questions they want answered. 



Examples: Parents 
^ress 



CONTENTS OF AN EVALUATION REPORT 



In developing and writing a technical evaluation report, the following are 
components often included: Reports generally address all of these major 
topics but may have diferent sub-headings under each. The report should 
provide systematic information to communicate to the reader all the pertinent 
aspects of the study. 

1 . Title Page 

2. Executive Summary 

3. Table of Contents 

U. Introduction 

A. Background, context 

B. Description of program 

C. Objectives of program 

D. Evaluation questions 

E. Identification of audiences 

5. Methodology 

A. Evaluation design 

B. Sampling procedures 

C . I nstrumentation 

D. Study procedures 

E. Data analysis procedures 

6. Presentation of the Data and Discussion of the Results 

A. Data presentation-tables, figures, narrative (as appropriate) 

B. Discussion of results 

7. Conclusions and Recommendations 

A. Summary findings 

B. Conclusions 

C . Recommendations 

8. Bibliography or List of References (if appropriate) 

9. Appendices 
10. Documentation: Standards for Evaluation 
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Title Page 

The title page serves the purpose of identifying a specific evaluation 
report. The information that it provides should be specific enough to allow 
the reader to distinguish a given report from among many. ^ 
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The kinds of information to include on the title page can be determined 
by the writer's responses to several questions: 

a. What kind of study is being reported? 
Example: Annual Evaluation 
What is the name of the program being studied or evaluated? 
Example: State-Funded Compensatory/ Remedial Program 

c. Where was the program or study carried out^ 
Example: Sample Pari^ School System 

d. Where is the school or system -located , and how may a r;eader make 
contact for more information if desired? 

A 

Example: 2U1U Center Street^ 

Midville, Louisiana 72809 
3^8/433-7825 

e. Who is the writer/evaluator? 
(Note : The name of the e valuator should be typed for the 
reader's benefit. The evaluator's original signature may also be 
affixed to verify that he/she assumes responsibility for the 
contents dV the report.) 



Example: Submitted by: 
(signature) 

(typewritten) Jane Blow, Certified Level A Evaluator 



f. Who is the chief administrator of the school system (when a report 
Is being submitted from the system to another agency)? 



Example: (signature) 

(typewritten) John Doe, Superintendent 



ERIC 



7 



g. When was the program time-period covered by this report? 

Example: 1982-83 Regular School Session 

r 

h. When is the submission date of the report? 

Example: June 15, 1983 

i. To Whom is the report b§ing submitted? 

Example: Submitted to: 

Louisiana State Department of Education 

j. Why is the report being submitted? 

Example: To fulfill the requirements of State 

Department of Education Addendum to 
Bulletin 1566 of 1980 

The writer selects the pieces of information nec^sary to the identification of 
the specific report and organizes them in a well-balanced manner on the title 
page. (Note that in the following example items a, b, c, and g were used 
to develop the report title.) 



Example: 



(a) 

(b) 



Annual Evatuatton of th« 
Sampla Pin»h Sctxwl Syitam 
SUta-f^undad Com%^r\tMXory i 
Ramadlatton Program 
r9a2-a3 Raguiar 
SchocM ^Mion 



(1) Submittad to* 

LoulBiana Oapartmant of Educatton 

(j) To fulfill tha Raquiramanti of 

Addandum to Ouliatln 15«« 



Submittad by 



rn fa) 



(d) 
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John Ooa 
Supartntandant 



Jana Blow 

Caniflad Laval A Evaluator 



1%M C*ntar Straat 
MIdvHIa. Loulitana 73109 
311/433-7123 



July 19. 1913 
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Executive Summary 



The purpose of the executive summary is to provide condensed 
highlights from the total report. The executive summary is developed >after 
the technical report is completed. This section allows decision-makers, 
policy-development groups, and other reviewers to have the essential 
information immediately ' before them without their having to leaf through the 
various parts of the technical report. Pagination- is usually small Roman 
numerals. 

The executive sutnmary generally consists of the following conrtponents: 

1. Description of program and purpose of the evaluation^ — This section 
describes the program in one or two short paragraphs. It tells what the 
program is„' where it was held, when it was established, and why the 
evaluation was conducted. 



Example: 

Description of Program and Purpose of the 
Evaluation: The State-Funded Compensatory/ 
Remedial Program was conducted in four elementary 
schools in Sample Parish School System during the 
1 982-83 regular school session. The program was 
estajDiished to provide language arts and /or 
mathematics remediation to the ^2^ parish students 
lacking minimurti skill attainment on the Grade 2 
Louisiana Basic Skills Test administered in April 
1982. Three of the schools provided pull-out 
programs during the day, one school conducted^ an 
after-school pi^ogram, and one school provided 
remedial instruction .within the classroom as part of 
the normal coursework. The program evaluation 
was conducted tg comply with guidelines of the 
Louisiana Board of Elementary and Secondary 
Education as contained in Louisiana State 
Department Addendum to Bulletin 1566 of 1980. 
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2. Statement of the evaluation questibns--This component identifies the 
questions addressed in the conduct of the evaluation. ^ 

Example: 

Evaluation Questions: The following clusters of 
questions were used to guide the evaluation: 

1 ) How did students perform in the Sample Parish 
School System Compensatory / Remedial Program? 

2) How did Sample Parish coordinate planning and 
curricula? * 

3) What constituted the instructional program of 
the Sample Parish Compensatory/ Remedial 

0_ * Program? 




3. Procedures /methods—This section summarizes information included in the 
Methodology section of the technical report. The summary should brrefly 
contain a description of how and on whom data were collected, a list of 
instruments used/ and the time perfod over which data were collected. 

Example:^" ^ 

• / " Procedures /Methods: The effectiveness of tjie 
Sample Parish 1982^83 Compensatory / Remediation 
Program was evaluated through the use of a one 

1 o group pretest-posttest design. The April 19jB2 

Grade 2 Louisiana Basic Skills Test scores for 
qualifying students provided pretest data. The 
Sample Parish Compensatory Test .was administered 
to students as a posttest between the dates o^pril 
V15 and April 30, 1^81; Surveys were distributed to 
five compensatory /remediation teachers on March 30,^ 

, 1983. The surveys were collected by the program 

director. on April 6. x 

r 

4. Conclusions—The purpose of this section is to briefly list major, 
conclusions in a format th^at highlight| each. Re.commendations and/or 
Areas of Concern may or may not be included in this section, dependent 
on their potential role in the decision and policy making processes. 



Example: 

Conclusions: Based on tY}e summary of findings, 
these r^ajor conclusions carl be drawn: 

• Information examined in this study indicates that / 
the Sample Parish Compensatory /Remedial Program / 
; was implemerfted in accordance with the^ State 

Department of Education Guidelines. 

^ As evidenced by the analyses of data collected in 
this study, student participants in the 1982-83 - ^ 
Sample Parish Compensatory /Remedial Program 
made significant gains in language arts and 
mathematics. 

r , ■ 

T^le of Contents 

This component of the evaluation report provides a listing of the 
contents of the report In table form* Its purpose is to allow the reader 
access to specific sections of the report quickly. The Table of Contents 
generally lists major headings and subtitles with the page number on which 
each part begins. The table may use an Indented outline format or a block 
format* 



Example: 

Table of Contents 



Executive Summary ^ i 

I. Introduction 1 

V. Methodology 15 

A. Evaluation Design 15 

B. Sampling Procedures 16 

C. Instrumentation 18 



If the report contains a large number of tables, figures, charts, graphs, 
maps, diagrams, or other illustrations, the writer may find it helpful to 
prepare ^ists of these separate from the Table of Contents. 



Example: 



List of Tables 



Table." 1: Student Participation by School and 
Subject Area in the Sample Parish 
1982-83 Compensatory/Remedial Education 
Program 



25 



Table 2: Number and Percentage of Students 

' Deficient in Each Skill Prior to and 
Upon Completion of the 1982-83 Sample 
Parish Compensatory/Remedial Education 
Program as Reported on the Student 
Profile 



'33 



Introduction 

The purpose of this section of the report is to Introduce the study to 
the reader. The Introduction is written' in such a manner that one totally 
unfamiliar with the study might readily grasp an understanding of the 
^program, the setting, and what the study was meant to accomplish. 
Background and context, a description of the program, objectives of the 
program, evaluation questions, and Identified audiences are the kinds of 
information the writer may wish to include in the Introduction. 

The Introduction chapter generally consists of the following components: 

1. Background, context-Thls section usually describes the conditions or 
events that preceded and led, to the development of the particular 
program being studied. Information about attendant circumstances 
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that occurred while the program was in operation may also be given. 
Background may include information concerning State legislation that 
led to the development and implementation of the Louisiana Basic 
Skills Test and the State-Funded Compensatory/ Remedial Program or 
any competency testing and/or remediation programs the local system 
provided prior to implementing the Stated-Funded Program. 
Conditions or circumstances that occurred within the context of the 
program that influence evaluation outcomes may be noted. 

2. Program description^-The purpose of this section is to describe the 
program that is being evaluated. In the example case, the writer 
describes the Compensatory / Remedial Program in Sample Parish 
School System for the regular school sessipn. This portion of the 
report includes information concerning numbers of students given 
remedial instruction in language arts, math, or both; beginning and 
ending dates of program year; student scheduling in minutes per 
day, per week, and total year; the organizational structure of the 
program,* and number and specific names of schools participating in 
each program structure. ^ 

3. Objectives of the program-This section identifies the objectives of 
the program. The objectives are stated in measurable terms in order 
to be useful in, the evaluation process. While the evaluator may 
assist with the wording of the objectives, he/she should use caution 
and insist on obtaining objectives developed by program staff. This 
activity should be accomplished very e%rly in the program and 
should be done cooperatively by program staff and evaluator. At 
report writing time, the objectives are simply copied in the report 
by the writer/evaluator. You may highlight them for clarity by 
numbering each objective and using an indented format. The 
findings are measured against evaluation objectives to determine the 
conclusions, concerns, and recommendations. - 4 



Example; 

The Sample Parish Compensatory /Remedial 
Education Program will reduce the number of 
language arts and mathematics skill deficiencies 
identified among qualified participants on the 
Grade ^ Basic Skills Test. ^ 

Evaluation questions - This section lists all the questions that guided 
this evaluation. The questions should be listed in a format so that 
each is easily identifiable on the page. They should be written 
concisely, and with clarity. 
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Example: 



1 . How many students participated in the . 
Sample Parish Compensatory/ Remedial 
Education Program during the T^82-83 
school year? 

2. What effect did participation in 
compensatory education have on the removal 
of identified skill deficiencies? 

3. What are the instructional characteristics of 
the Sample Parish Compensatory/ Remedial 
Education Program? 

5. Identified audiences-'The purpose of this section is to list those 
groups of people having interest in the evaluation of this program. 
In the process of developing the list of potential audiences, the 
evaluator actually thinks about people who may ultimately read the 
report or one of its shorter versions and directs the writing to 
them. He/she may purposely develop various types of reports for 
the different audiences, dependent on the needs of each group. 



Example: 

Primary Audiences: 

State Department of Education 
Program Administrators 

Other Audiences: 

Sample Parish School Board members 

Central office personnel 

School Principals 

Teachers 

Pa rents 

Professional Colleagues 
Press/Media ^ ' 



Methodology 

This portion of the report describes the procedures used in conducting 
the evaluation. It gives enough detail so that the reader is able to 
understand the techniques used, judge whether the findings are valid, and 
reproduce the evaluation study. 

The following components are Included in this chapter: 

1. Evaluation deslgn-Thls segment provides a brief picture of your 
general design strategy. In addition to Identifying the type(|^f 
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design^ this description shows how the measurement used, the group 
studied, and the treatment provided (compensatory instruction, 
teacher training, etc.) interact so that the reader can look at the 
^ logic of the study and judge whether the findings are due to the 
program or to some other outside factor. 

2. Sampling procedures-ln this section of the chapter the sampling 
procedures are described to demonstrate that the group studied is 
representative of the entire population of interest so that the 
findings may be validly applied to that population. In some cases 
the group studied may be the entire population rather than a 
sample. 

3. Instrumentation-The purpose of this component is to describe what 
instrument was used in measurement so that the reader can decide 
whether or not to accept your findings. Information should be 
provided about the reliability and validity of the instruments/ 

U. Study procedures-The purpose of this component of the Methodology 
chapter is to describe how the study was conducted with enough 
detail that the reader is able to replicate it, if desired. The 
description enables the reader to judge whether the data collection, 
instruments were appropriate for addressing the evaluation questions 
and whether they were used properly. The participants to whom 
each instrument was administered are identified as well as the 
delivery system enpployed to collect "the data. Any limitations 
encountered that may have caused the study to depart from the 
original design should be cited arid explained. A chart of all of the 
evaluation activities generally proves to be useful. Such a chart 
may include the evaluation questions, proposed data collection 
strategies, data sources, and projected timelines. 

5. Data analysis .procedures-The method(s) by which the data were 
treated is described in this section so that the reader can judge 
whether the conclusions are justified. The processing of the raw 
data should be explained, and the statistical procedures employed 
should be described. . ^ 



Presentation of the Data and Discussion of the Results 

The purpose of this chapter is to present the data collected In the 
conduct of the evaluation, to use the data to answer each evaluation 
question, and to discuss tjie restilts obtained. In the search for the most 
effective way to present data, the following quotation taken from Statistical 
Methods in Education and Psychology by Class and Stanley contains valuable 
Information: 

"It Is sometimes said that the facts speak for themselves. 
In reality , statistics often stand speechless and silent, 
tables are sometimes tongue-tied, and only the graph cries 
aloud Its message." 
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When properly " constructed and described, tables and figures not only 
convey data summaries of the written evaluation report, but also they 
provide visual information for oral presentations. For this reason, the best 
approach for preparing the results and discussion chapter is to construct 
the tables and graphs first. 

The following suggestions taken from How to Present an Evaluation 
Report by Morris and Fitz-Cibbon provide useful information in developing 
the tables and graphs required in your evaluation report: 

1. Use graphic methods of presenting numerical data whenever possible. 

2. Build the results and discussion section of the evaluation report 
around tables and figures. Prepare these first and then write text 
to explain them. 

3. Make each table and figure self-explanatory. Use a clear, complete 
title, a key, labels, footnotes, etc. 

4. Discuss in the text the major information to be found in each table 
and figure. 

5. Consider using as many graphs as you have the time and ingenuity 
to prepare. They often serve a dual purpose: they communicate ; 
clearly to your audiences, and they also help you to see what is 
happening. * 

6. Since graphs generally convey fewer details than numerical tables, 
you may sometimes want to provide both tables and graphs for the 
same data. 

7. When presenting complicated graphs to a live audience, give some 
directions about how to read the graph and a few sample 
interpretations of simpler versions prior to presenting the real data. 

Examples: 

The following tables and figures are presented as examples for 
incorporation into the results and discussion chapter of the 
written compensatory education evaluation report. Each is 
prefaced by a sample evaluation question that the data may be 
used to address. 

1 • Student Performance 



Evaluation Question 1 : How many compensatory 
education students paRicipated In each instructional 
area within each school in Sample Parish? 
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Table 1 . Student Participation by School and Subject Area in the Sample 
Parish 1982-83 Compensatory / Remedial Education Program 



Frequencies by Area of Participation 





No. Students 


No. Students 


No. Students 


School 


School 


Lang. Only 


Math Only 


Lang.& Math 


Totals 


A 


15 


7 


18 


40- 


B 


10 


8 


14 


32 


C 


12 


6 


16 


34 


D 


5 


3 


10 


18 


Area Totals 


42 


24 


58 


1 24 



Similar information that may be presented in addition to or 
in place of that displayed in Table 1 could be shown in 
Figure 1 . 




Figure 1. Percentage Participation in the Sample Parish 1982-83 

Compensatory /Remedial Education Program by Subject Area(s) 
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Evaluation Question 2 : What effect did student participation in 
the 1 982-83 Compensatory / Remedial ' Education Program have on 
the removal of identffJed skill deficiencies in language arts 
and/or » mathematics? 



Table 2. Number & Percentage of Studen^ts Deficient in Each Skill Prior to S 
Upon Completion of the 1982-83 Sample Parish Compensatory/ 
Remedial Education Program as Reported on the Student Profile 

N =: 80 





Skill Deficiencies 


Skill Deficienties 


Percentage 




Prior to 1982-83 


After Participation 


Change 




Comp. Ed. 


in 1982-83 Comp. Ed. 




Skill 


No. Students 


% 


No. Students 


% 




% Before- 
% After 


Language Arts: 












Skill 1 


20 


25% 


8 


10% 


+15% 


Skill 2 


ia 


17.5% 


6 


7.5% 


+10% 


Skill 3 












4 












5 

6... 












Mathematics: 










\ 

\ 

/ 

' +8% 


Skill 1 


12 


10% 


4 


' 2% 


Skill 2 


9 


11% 


5 


6.2% 


+4.8% 


Skill 3 












4 










5 












6 • . . 













Similar information that may be presentecL/H addition to or In plaqe of that 
displayed in Table 2 may be shown'' in Figures 2 and 3. 
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Percentage 

of Students 
Deficient 
in Each 
tdentmed 
Language 
Arts Skill 



35% 
30% 
25% 
20% 
15% 
10% 
5% 




1 2 3 5 6 " 8 9 10 n 

r 

Language Arts Skills 



Figure 2. Language Arts Skill Deficiencle* Prior to and Upon Completion 
of the 1982-83 Sample Parish Compeniatory/ Remedial Education Program 



« Deflcienclei before 1982-83 Comp. Ed. 
■ Defloenclei after 1982-83 Comp» Ed. 



35% 



30% 

Percentage 

of Students 25%. 

Deficient 

in Each 

Identified 20% 
IMath Skill 

15% 
10% 
51 




2 3 * 5 6 7 • 9 10 11 12 13 1« 15 
Mathematics Skills 



FlQure 3. Mathematics Skit! Deficiencies Prior to and Upon Completion of 
the 1912-13 Sample Parish Compensatory/ Remedial Education Program 



Deficiencies before 1912-13 Comp. Ed. 
Deficiencies after 1912-13 Comp. Ed. 
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Evaluation Question 3 : What effect did student 
participation in the 1982--83 Compensatory / Remedial 
Education Program have on language arts and/or 
mathematics achievement? 



Table 3. Compensatory/ Remedial Student Performance on the BSJ and the 
Sample Parish Test 





BST 


Parish Test 


Mean 
Differ- 


T- 


PR 




Mean STD 


Mean STD 


ence 


Statistic! Value 

i 


Language Arts 
N = 65 


55.8 12.5 
(sample) 


76.8 16.2 


21 .0 






Mathematics 
N = 25 


62.0 11.4 


80.5 14.2 


18.5 







In addition to Table 3 graphs displaying the mean scores 
on the BST and the , Parish Test in language arts and 
mathematics are shown in Figures 4 and 5. 



Language 
Arts Means 
in APCs 



80 -- 



70 



60 
50 



77 



56 



BST 



Parish Test 



Figure 4. Student Performance on the BST and Parish Test In 
Language Arts 
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Math Means 
in APCs 



80 ■■ 



70 -■ 



60 " 



50 - 









80.5 














\ 










62 








1 









BST 



Parish Test 



Figure 5. Student Performance on the BST and Parish Test in 
Mathematics 



Coordination 



Evaluation Question U : Does the Sample Parish 1982-83 
Compensatory/ Remedial Education Program provide for 
planning coordination in determining the content of each 
student's program and successful mastery of deficient 
basic skills? What documentation exists in this area? 



In addressing this question good sources are summary data 
filled in on the instrument(s) used to obtain that information. 
These could be questionnaires, observation forms, checklists, 
logs, interview forms, summaries of existing records, etc. 



A summary table developed from an existing questionnaire 
could be used as illustrated on the next page. 
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Table 4. Summary Data in Response to the 
Planning Coordination Questionnaire 

Pl^anning Coordination Questionnaire 
N = 5 
( Parish level) 



With whom did you meet to plan the content of your 
students' compensatory / remedial education programs? 

5 Regular teacher(s) 

Special education teacher(s) . 
Chapter I teacher(s) 
Other ( ' ) ' 



How many meetings were held with these individuals 
prior to and during the 1982-83 Compensatory Education 
Program? 



{ No, meetings No^ mfiet ings 

i prior (mean) during (mean) 

t< 

3,6 Regular teacher(s) 5.2 
. 2,3 Special education teacher(s) 2,7 

1 ,8 Chapter I teacher(s) 1 .6 

TT Other ( ) TS" 



What methods were used ^q^^sgss student mastery of 
pre-identified deficient skills? 

5 Observations of daily classroom performance 
3 Performance on teacher-developed tests 

2 Performance on basal tests 

^ Performance on parish, PDC, and/or purchased 
standardized tests 

3 Performance on the 1983 Second Grade Basic Skills 
Test ^ 

2 Other (name these^ ) 
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Evaluation Question 5 : Does the Sample Parish 
1 982"-83 Compensatory/ Remedial Education Program 
provide for curricula r coordination of 
compensatory/ remedial instruction with regular 
Instruction and with other academic programs in 
which students may participate? What documen-- 
tation exists In thi s area? 

In addition to the Information provided In Table 4 
summary data may be presented within the 
following Instrument: 
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Table 5. Summary Data in Response to^ the 
Curricular Coordination Questionnaire 



Curricular Coordination Questionnaire 

N = 5 

ii ( parishwide classroom means) 

How many compensatory education students are you 
assigned to work with on a weekly basis? 

Of this number, how many also receive the following 

a. Special edtw:ation instruction 

b. Chapter I instruction 

c. Both special education and Chapter I 

d. Other (name ) 



8.3 



5.2 



TTT 



Instruction 



Evaluation Question 6 : 
characteristics oT" 



What are the instructional 
the Sample Parish 1982-83 



Compensatory/Remedial Education Program? 



Summary data from a questionnaire (Table 6) may be used 
to answer this question. 
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Tibl« i. Summary Data In Raipoma to tha 
CompanMtory/R*m«dial Educjtlon Taachar 
. ->rtfortn»t(on Form ^ 

Ta»char Information Form 
N • 5 

1 Chack tha raiponii which daicrlbai tha itructura of tha 
Sampla ParUh 1M2-I3 Compan^tory Education Pfrjgram. 
''^jj Aftar tchopl program 

^^ Pull-out from tha Claiirotom during tha day 
nr Iniiructlon within lha claiiroom at P«rt of tha 
noR^I courtawork ^ 
0 Cmii^ <daicr<b« , ' 

2. • On a waakfy baili. ^>om many mmutai of compantatofy 

tducation Instruction ira providad for aich itudant ^ 
with whom you work! 

3. How many waaki of companiatory aducatlon fnitructt^ 
ara plannad for aach itudant^ 

For aach Itam chack tha raiponia that ^att matchai your 
axtant of uta: 

F If you uiad It FREQUENTLY (ilmoit avary day) 
S If you uiad U SOMETtMES { about onca ■ waak) 
R If you uiad It RARELY fonly ■ fa^ timai) 
N If you NEVER uiad It although Jt wa| availabia • 
U if It wai UNAVAILABLE to you 



• . Matartali uiad In taaching companiatory aducatlon 

a. lyitam adoptad taxti and workbooki 

b. programmad matartali 

c. lupplamanury taxti and workbooki 

d. lUta Banc Skllli Tait raporti 
a. itata Curriculum Guldai 

f. atudant proflla formi providad by tha lUta 

gjf your parlih'f critarlon rafarancad taiti 

h. taachar prmpMrtxS matarlali 

I. Othar (what?) 




5. InitructJonal ^Aanagamant Uathodi Uiad In ^ 
- providing Companiatory Education Initructton: 

a. diagnoili of itudant parformanca lavaii 

b. monitoring and racordlng itudant prograii 
maintananca of Individual itudant foldari 
uia of bahavlor modlHotlon td^hnlquai 



c. 
d. 
a. 



poitlng and anforciog 
bahavlor 




claiiroom 



f. admlnlitratlon of maitary taati 

g. uaa of computar aailitad/computar managa<^ 
Instruction 

h. UM of m«atary laaming tachnlquai 
(ECm. ate.) 

I. Madallna Huntar mathodt (Critical 
Ctamanu of Taaching) 

|. UM of Inatructlonal talavlalon 

k. grouping fbr Initructkm baaad on 
parfomMnca (iklll grouping) 

I. uaa of drill and practka 
n. uaa af auauinad tllant reading 
n. ' UM of tMctiar aAdat 
o. Ufa mf v«luntaari 
p. UM of atudant tuton 
q. UM of tpaclal aducatlon taachart 
aa a raaourca 

f. ttlMif (arhat?) , 



F 


s 


R 


N 




80% 


20% 








20% 


20% 


JrO% 






20% 


»o% 


<0% 






100% 










100% 










100% 










10% 


"20% 


\f 






10% 


m 

20% 


10% 






100% 










100% 










10% 


20% 


30% 


lot 




10% 


30% 


♦0% 






100% 














30% 


10% 




♦0% 


30% 


30% 






•0% 


30% 


30% 


30% 





30% 



]m 

100% 

<0% 3f% 

J0% ^ 

20% 

30% 30% 

30% 30% 



10% 



_%0% 
10% 



30% •0% 



10% 
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Conclusions and Recommendations 

The\ purpose of this chapter is to present the findings, conclusions, 
and reco/imendations that are made on the basis of the information that was 
collected. In most instances the findings, cqnclusionis, and recommendations 
carHSest be presented in a listing format rafther than in narrative form. 

This chapter Is usually the most influential part of the evaluation , 
report. This chapter places emphasis on what is important and clearly 
distinguishes between conclusions that must b^ tentatively rather than firmly 
drawn. All concerns that were addressed by the stated evaluation questions 
must be attended to. 

The following components are generally included in this chapter: 

1. Summary of findings-ln this section findings are listed in summary 
forhi. This provides a global view of , the outcomes of the study 
and greatly facilitates the development of conclusions and 
recommendations. 

r 2. Conclusions-ln developi^pg this section examine the jsummary of 

findings to determine what major conclusions may be drawn about 
the effectiveness of the program. . • ' 

3. Recommendations-ln this segment findings and conclusions are the 
b^es upon which recommendations are to be made. In developing 
Conclusions and recommendations the writer must not assume the 
role of the policy maker concerning wnether to continue funding the 
program. 

Example: ^ 

*» 

Bad - The Sample Parish Compensatory/ Remedial ' 
Education Program should be continued 
during the 1983-84 school year. 

Better - The information obtained in the . evaluation 
of the Sample Parish Compensatory/ Remedial 
Education Program indicates that the goals 
set forth for the 1982-83 program were met. 

Bibliography or List of References 

If a literature review was conducted, this component provides a list of 
the references consulted in developing the * evaluation report. This may 
* include departments and/or individuals who provided pertinent information 
and assistance. 

Appendices ♦ 

The purpose of the appendix section is to present information that Is 
referenced In the text but which. If Incorporated within the main body of 

O . 23 , - 
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the report, would disrupt the flow and readability of the text. The 
following types of information are often incorporated into appendices: 

1. Sample instruments (if not copyrighted) 

. 2. Raw data 

3. Long tables 

4. Letters or other correspondence 

5. Referenced articles, chapters, parts of earlier reports 

6. Diagrams, figures 



Documelfation : Standards for Evaluation 

The purpose of this section is to demonstrate the application of the 
Standards for Evaluations of Educational Programs, Projects, and Materials as 
prescribela by the Louisiana State Board of Elementary and Secondary 
Education. Completion of a document similar to the following will satisfy the 
State Board mandate: 

1. Anyone who accepts and executes responsibility for planning, 
.implementing, and reporting evaluations of educational programs and 

projects approved by thje State Board of Elementary and Secondary 
Education must have a vaiid^Louisiana program evaluator's certificate. 

2. The evaluations of educational programs and projects approved by the 
State Board of Elementally and Secondary Education must demonstrate 
application of the Stan^rds for Educational Evaluations set forth by the 
Joint Committee on Standards for Educational Evaluations and approved 
by the State Board on January 20, 1981 . 

S 
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APPENDIX 

Demonstration of Application of the Standards for Evaluations of 
Educational Programs, Projects, and Materials: 1982-1983 
Local Compensatory/ Remedial Program Evaluations 



\ 
\ 
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DEMONSTRATION OF APPLICATION OF THE STANDARDS FOR EVALUATIONS OF 
EDUCATIONAL PROGRAMS, PROJECTS, AND MATERIALS: 1982-1983 
LOCAL COMPENSATORY/REMEDIAL PROGRAM EVALUATIONS 



Completion of a document following this format will satisfy the State-Funded 
Compensatory/ Remedial Program Regulation ):oncerning application of the 
State Board-Adopted Standards for Evaluations (p. 7, VII B (4)). This 
form should be attached as an appendix to the local evaluation report 
submitted to the State Department of Education for referral to the State 
Board of Elementary and Secondary Education. 

INSTRUCTIONS 

1. For each Standard listed below, describe the activity, object, or 
parties involved in meeting the Standard. Instead of providing a 
narrative description you may cite the page in the evaluation report 
containing this information, if appropriate. 

2. If you considered a Standard to be not applicable to the evaluation, 
write NA. 

3. If you considered a standard to be applicable but were unable to 
apply it for any reason (time, resources, information, etc.) write NF 
for not feasible . 

4. Please explain why a Standard was either NA or NF. 

5. Refer to the Joint Committee on Standards for Educational EvaluatiorT, 
Standards for Evaluations of Educational Programs , Projects , and 
Materials (IV(cnraw-Hill , 1981) for further discussion of the Standards. 



School System: Date: 

Evaluator: 



Person CompJeting Report 
If Other Than Evaluator: 



A1) Audience Identification: 



A2) Evaluator Credibility: 
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A3) Information Scope and Selection: 3i 
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A4) Valuational Interpretatio 



A5) Report Clarity: 



A6) Report Dissemination: 



A7) Report Timeliness: 



A8) Evaluation Impact: 



Bl) Practical Procedures: 



B2) Political Viability: 



B3) Cost Effectiveness: 



CI) Formal Obligation: 



C2) Conflict of Interest: 



C3) Full and Frank Disclosure: 



CU) Public's Right to Know: 



C5) Rights of Human Subjects: 



C6) Human Interactions: 



C7) Balanced Reporting: 



C8) Fiscal Responsibility: 



Dl) Object Identification: 



D2) Context Analysis: 



D3) Described Purposes and Procedures: 



D4) Defensible Information Sources: 
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D5) Valid Measurement: 



D6) Reliable Measurement: . ^ 



D7) Systematic Data Control: 



D8) Analysis of Quantitative Information: 



D9) Analysis of Qualitative Information: 



D10) Justified Conclusions: 



D11) Objective Reporting: 
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CLOSING REMARKS 



It is hoped that this monograph will provide useful information to 
educational program evaluators in the development of evaluation reports. 
The authors would be most appreciative of any comments and/or suggestions 
that the readers of this paper would like to sybmit. It is only through such 
a cooperative effort that educational program evaluation can be strengthened 
in Louisiana. 





ERIC 




THE LOUISIANA ROUND TA 
John Austin 
Barbara 1. Bankens 

Ruth R. Berlin 
Ellen B. Gillespie 
Lee M. Hoffman 
Donald L. Hoover 

Charles M. Hunter 

Lola C. Kendrick 

p. 

Jerome L. Matherne 
Sarah C. Morrison 

Ellen Pechman 

Antoinette T. Price 
Janella Rachal 
William E. Schroyer 
James A. Taylor 
Suzanne Triplett 



LE OF PROGRAM EVALUATORS 



Test £ Research Consultant 
Jefferson Parish Schools 

Director of Research, 
Development and Assessment 
Calcasieu Parish School Board 

5th District PDC 
West Monroe, LA 

Administrative Officer 

State Department of Education 

Section Chief, Bureau of Evaluation 
State Department of Education 

Director, Research and 
Program Evaluation 

East Baton Rouge Parish School Board 

Administrative Officer 

State Department of Education 

Research Specialist 
Caddo Parish Schools 

Title I Director 

West Feliciana Parish School Board 

Director, Program Evaluation Section 
Division of Administration 
Baton Rouge, LA 

Director, Department of 
Research and Evaluation 
New Orleans Public Schools 

Supervisor of Guidance 
Caddo Parish School Board 

Administrative Officer 

State Department of Education 

Director, Testing and Evaluation 
Jefferson Parish Public Schools 

Director, Research and Evaluation 
New Orleans, LA 

Director, Bureau of Evaluation 
State Department of Education 



